ON THE SINGULARITY OF RANDOM COMBINATORIAL MATRICES 



Abstract. It is shown that a random (0, 1) matrix whose rows are independent random 
vectors of exactly n/2 zero components is non-singular with probability 1 — 0(n~'^) for 
any C > 0. The proof uses a non-standard inverse-type Littlewood-Offord result. 



1. Introduction 

Let An denote a random n by n matrix, whose entries are iid Bernoulli random variables. 
A classical result of Komlos [H [IT] shows 



P{An is singular ) = 0{n ^/^). 

By considering the event that two rows or two columns of An are equal (up to a sign), it is 
clear that 



P{An is singular ) > {1 + o{l))n'^2^-'' . 

It has been conjectured by many researchers that in fact this bound is best possible. 
Conjecture 1.1. 

P{An is singular ) = + o{l))^. 

In a breakthrough paper, Kahn, Komlos and Szemeredi [8] substantially improved the upper 
bound to 

F{An is singular ) = 0(.999"). 
Another significant improvement is due to Tao and Vu [21] to obtain the bound 

P{An is singular ) = 0((3/4)"). 

The most recent record is due to Bourgain, Vu and Wood [2], who improved it to 0(( 1/^/2)"). 

All the proofs use a result of Erdos and Littlewood-Offord in one or another way. We will 
discuss this result in details in Section [2j 
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Another popular model of random matrices is that of random symmetric matrices. This 
is one of the simplest models that has non-trivial correlations between the matrix entries. 
Let Mn denote a random symmetric n by n matrix, whose upper diagonal entries are iid 
Bernoulli random variables. Despite its obvious similarity to the non-symmetric case A^, 
less is known concerning the singularity bound for M„. 

The question to determine whether the singular probability of M„ tends to zero together 
with n was first posed by Weiss in the early nineties. This question had been open until a 
recent breakthrough paper by Costello, Tao and Vu 0], who showed P(M„ is singular) = 
j^-i/8+o{i)_ Although the bound 0(n^^/^+°(^)) can be improved further by applying the 
more recent inequalities from [3j, it seems that their method cannot give any bound better 
than n~^/'^~^°'^^\ In [13j, the author of this note was able to improve the bound to 0{n~'-^), 
for any C. The best current bound is due to Vershynin [21] who shows P(M„ is singular) = 
exp(— n'^), for some small positive constant c. 

The common feature of the two random matrix ensembles An and M„ is that the entries 
in each row or column are independent. Our main focus is on a simple model where this is 
not the case. 

Let n be an even number, and let Qn be a random (0, 1) matrix whose rows are independent 
vector of exactly n/2 zero components. This matrix model resembles that of A^ where the 
entries are iid Bernoulli random variables which take value and 1 with probability 1/2. 
One can also view Q„ as a non-symmetric version of the adjacency matrix Rn,n/2 of a 
random n/2-regular graph. 

Estimating the second largest eigenvalue of the adjacency matrices Rn,d of random d-regular 
graphs is a well-known problem in combinatorics and theoretical computer science. How- 
ever, much less is known about the singularity of such random matrix model. It has been 
conjectured by Vu that 

Conjecture 1.2. [23] Assume that d > 3 is a number which may depend on n, then Rn^, 
the adjacency matrix of a d-regular graph, is non-singular almost surely. 

It has been shown (for instance in |18j ) that the singularity probability plays a crucial role 
in proving certain local limit laws involving matrix parameters. The main difficulties of 
the above conjecture come from two primary constraints: the matrix must be symmetric, 
and each row vector must have exactly n — d zero entries. Our main goal is to relax the 
symmetry constraint, working with matrices whose rows are independent (0, 1) vectors of 
exactly n — d zero entries. Although our method may work for a wide range of d, we will 
focus on the case d = n/2 only, showing that such random matrix is non-singular almost 
surely. 

Theorem 1.3 (Main result). For any C > we have 



P{Qn is singular ) = 0(n ), 
where the implied constant depends on C. 
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By considering the event that two rows of Qn are equal, it is clear that Qn is singular with 
probability at least + o(l))". We conjecture that this is also the right bound. 

Conjecture 1.4. 

P(Qn is singular ) = (- + o(l))". 

The paper is organized as follows. In the next section we discuss the result of Erdos and 
Littlewood-Offord and its variants in details. After providing further necessary ingredients 
in Section [3l we complete the proof of Theorem 11.31 in Section [H 

Notation. 

For an event A, we use the subscript Px(j4) to emphasize that the probability under con- 
sideration is taking according to the random vector x. 

For 1 < s < n, we denote by e^ the unit vector (0, . . . , 0, 1, 0, . . . , 0), where all but the s-th 
component are zero. 

2. The main tools 

Let Xi,i = 1,...,?7- be iid Bernoulli random variables, taking values ±1 with probability 
1/2. Given a set Aoin real number ai, . . . , a„, the concentration probability of A is defined 
to be 

n 

p{A) := sup P ( UiXi = a). 

1=1 

Motivated by their study of random polynomials, in the 1940s Littlewood and Offord [12] 
raised the question of bounding p{A). They showed that if the Oj are nonzero then p{A) = 
0(n~^/^ log n). Shortly after the Littlewood-Offord paper, Erdos [5j gave a combinatorial 
proof of the refinement p{A) < („/2)^~"- 

Since the pioneer results of Erdos and Littlewood and Offord, there has been an impressive 
wave of reasearch to improve the inequality by imposing new assumptions on the Oj's. These 
improvements include the works of Erdos and Moser [6], Halasz [TJ, Katona[9], Kleitman 
[TT] . Sarkozy and Szemeredi [16], and Stanley [17] . 

Recently, Tao and Vu have brought a different view to the problem. Instead of following 
the classical settings, they tried to find the underlying reason as to why p{A) is large, say 
p{A) > for some C > 0. This created a new direction called inverse Littlewood-Offord 
problem. 

Note that the set A has 2" subsums, and p{A) > n~'^ means that at least 2"n~'-^ among 
these take the same value. This observation suggests that the set should have a very 
rich additive structure. To determine this structure, let us recall an important concept in 
Additive Combinatorics, generalized arithmetic progressions (GAPs). 
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A subset P of R is a GAP of rank r if it can be expressed as in the form 

-P = l^o + rriigi H h mrgr\Ni < < iV- 1. 

The numbers gi are the generators of P. The numbers Ni,N- are the dimensions of P. 
We say that P is proper if every element of P can be written as such a Hnear combination 
of the generators in a unique way. If — A'j = for ah i and if go = 0, we say that P is 
symmeinc. 

Assume that P is a proper symmetric GAP of rank r = 0(1) and size n'-^^^\ and assume 
that all the elements of A are contained in P. Then, by the additive property \nP\ < n'"|P| 
of P, we easily have p{V) = n{n~^^^^). 

This example shows that, if the elements of A belong to a symmetric proper GAP with a 
small rank and small cardinality, then p{A) is indeed very large. A few years ago, Tao and 
Vu |19^ [20] proved several results showing that this is essentially the only reason. 

Assume that p{A) > for some C > 0, then most of the elements of A belong to a 
symmetric proper GAP of hounded rank 0(1) and of small size nP^^\ 

Due to the applications they had, the sharpness of the inverse results was not addressed. 
In a joint work with Vu we are able to give an optimal version. 

Theorem 2.1 (Inverse Littlewood-Offord result). |14[ Theorem 2.5] Let e < 1 and C he 

positive constants. Assume that 

p{A) > n-^. 

Then, for any < n' < n, there exists a proper symmetric GAP P of rank r = Oe,c{^) 
that contains all but n' elements of A (counting multiplicity), where 

\P\ = OcAp-'/n"^')- 

The Erdos and Littlewood-Offord inequality emerges in the singularity problem of random 
matrices by the following simple observation: condition on the matrix An-i of the first n — 1 
rows, the determinant of An can be expressed as a linear form of its last row x = (xi , . . . , a;„) , 

det(^„) = XiOi H h XnOn, (1) 

where ai, . . . , are the corresponding cofactors of the matrix An-i- Thus, if we can prove 
that most of the Oi are non-zero (with respect to An-i), then it follows from the Erdos 
and Littlewood-Offord inequality that Px(det(A„) = 0) = 0(n^^/^). This approach was 
initiated by Komlos. 
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To prove Theorem 11.31 we reverse the approach of Komlos. First we express det(Q„) as a 
Hnear form if its last row x = (xi, . . . , Xn) 

det(Q„) = xiai -| h x^On, 

where oi, . . . , are the cofactors of Qn-i- 

Roughly speaking, our method consists of two main steps. 

• (Inverse Step) Assume that 

p*{A) := supPx(xiai H + a„x„ = a) > n~'^ , 

a 

where the probability is taken uniformly over all (0, 1) tuples {xi, . . . , x„) for which 
there are exactly n/2 zero components, then there is a strong structure among the 
cofactors ai, . . . , a„. 

• (Counting Step) With respect to Qn-i, the event that there exists a strong structure 
among the aj's happens with negligible probability. 

For the rest of this section, we focus on the Inverse Step. Details of the Counting Step will 
be presented in Section [H 

First, by using the relation p{A) = Q{p* (A) / y/n) , we can deduce directly from Theorem 
12. li the following result. 

Theorem 2.2 (Inverse Littlewood-Offord result for p*{A), I). Let e < 1 and C he positive 
constants. Assume that 

P*[A) > n-^. 

Then, for any n'' < n' < n, there exists a proper symmetric GAP P of rank r = Oe^c'(l) 
that contains all hut n' elements of A (counting multiplicity), where 

\P\=Oc,,[{p*{A))-^^/n"-'^). 

Observe that if A' is a translation of yl, A' = {ai + N, . . . ,an + N} for some A^, then 
p*{A) = p*{A'). On the other hand, symmetric GAPs do not preserve under translation. 
This suggests that we might obtain a more economical version of Theorem 12.21 by passing 
to consider non-symmetric GAPs. 

Theorem 2.3 (Inverse Littlewood-Offord result for p*, II). Let e < 1 and C he positive 
constants. Assume that < n' < n and A = {ai, . . . , o„} is a multiset for which there are 
no more than n — n' — 1 elements taking the same value. Assume furthermore that 



P*{A) > n- 
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Then, there exists a (not necessarily symmetric) proper GAP P of rank 2 < r = Oe^ci^) 
that contains all but n' elements of A (counting multiplicity), where 

\p\ = oc,eiip*i^)y'v^/^"'^')- 

In particular, 

|P|=Oc,.((p*(A))-iV^/n'). 

Remark that the essential advantage of Theorem 12.21 over Theorem 12.31 is that the rank r 
must be at least 2, which leads to a "gain" of a factor ^/nJ in the size of |P|. 



Proof, (of Theorem 12. 3p We consider a translation A' = {a[, . . . , o^} of A, where a- := ai+N 
and N is chosen to be sufficiently large. It is clear that 

p\^)=p*{A). 
Consider the concentration probability of A' . Because 

p(A') = n{p*{A')/V^) = n{p*{A)/V^) = n-O(i), 

Theorem 12.11 implies that there exists a symmetric GAP Q of rank r = 0(1) and size 
{p{A'))^^ /n'^^"^ that contains all but n' elements of A'. 

We now show that the rank r of Q must be at least 2. Assume otherwise that Q has rank 
one. Let d and L be its step and length respectively. Because Q contains at least two 
distinct elements a^j and Ojj, so 

d < loii — ai2 \ < \ai\. 

i 

On the other hand, we also have Ld > + ai| > — |aj|, and so 
d>{N-Y, \ai\)/L = ^{{N-Y, |a,|)n-«(i)). 

i i 

This bound contradicts with the upper bound 2 Y2i \ (^i\ if chosen to be large enough, 

and so Q must have rank at least 2. 

Next, recall that p{A') = n{p*{A')/^/E) = n{p* (A) / ^/E) . Thus, 

\Q\=0{{p*{A)r'V^/n'^-/'). 
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To complete the proof, we shift Q by —N to obtain a GAP P of the same rank and size 
which contains all but n' elements of A. □ 

We now draw two quick consequences of Theorem 12.31 

Our first result, which is similar to the inequality of Erdos and Littlewood-Offord, asserts 
that as long as A is not too trivial, p*{A) is small. 

Corollary 2.4 (Erdos-Littlewood-Offord inequality for p*). Lets < 1 be a positive constant. 
Assume that n}!'^^'^ < n' < n and A = {ai, . . . is a multiset where there are no more 
than n — n' — 1 elements taking the same value. Then we have 

p*{A) = 0,{^/n'). 
Proof, (of Corollary 12. 4|) Assume that for some sufficiently large C 

P*{A) > CV^/n'. 

Then, by Theorem 12. 31 there exists a GAP P of size |P| = Oe{{p*))^^ y/n/n') which contains 
all but n' elements of Oj. Because there are no more than n — n' — 1 elements among 
taking the same value, P must have size at least 2. On the other hand, the upper bound 
|P| = Oe{{p*))~^y/n/n') = Oe(C~^) shows that P can be forced to be empty if we choose 
C to be sufficiently large depending on e. This is a contradiction, and so 

p*{A) = 0,{^/n'). 

□ 

Improving earlier result of Erdos and Moser [6], Sakozy and Szemeredi proved in [T6] that 
if Oi are distinct then p{A) = 0(n~^/^). Our next consequence shows a similar bound for 
p*{A). 

Corollary 2.5 (Sarkozy-Szemeredi theorem for p*). Assume that A = {ai, . . . ,an\, where 
ai are distinct real numbers. Then we have 

p*{A) := 0(n-3/2). 
Proof, (of Corollary I2.5p Assume that for some sufficiently large C 

p*{A) > Cn-^/^. 

Then, Theorem 12.31 applied to n' = en implies that there exists a GAP P of size |P| = 
Oe((p*))~^-^/n/n') which contains all but en elements of Oj. Because the elements of A 
are distinct, P must have size at least (1 — e)n. On the other hand, the upper bound 



8 



RANDOM MATRICES OF EQUAL ROW-SUMS 



|P| = Oe{{p*)) ^^fnjen) = 0^(0 ^n) shows that P has size much smaller than en once we 
choose C to be sufficiently large depending on e. This is a contradiction, and so 

p*{A) = 0{n''^/^). 

□ 

3. Further supporting lemmas 

3.1. A rank reduction argument and the full rank assumption. This section pro- 
vides a technical lemma we will need for later sections. Informally, it says that if we can 
find a proper GAP that contains a given set, then we can assume this containment is 
non-degenerate. More details are followed. 

Assume that P = {go + migi + ■ ■ ■ + mrgr\Ni < rrii < N-} is a proper GAP, which contains 
a set [/ = {til, . . . .Un}. 

We consider P together with the map <^ : P — )• R*^ which maps go + rriigi + • • • + nirgr to 
(mi, . . . ,mr). Because P is proper, this map is bijective. 

We know that P contains U, but we do not know yet that U is non-degenerate in P in the 
sense that the set has full rank in R*". In the later case, we say U spans P. 

Lemma 3.2. Assume that U is a subset of a proper GAP P of size r, then there exists a 
proper GAP Q that contains U such that the foUowings hold. 

• rank(Q) < r and \Q\ < Or{l)\P\; 

• U spans Q, that is, 4>{U) has full rank in 'R^^^'^KQ) ^ 

To prove Theorem 13.21 we will rely on the following lemma. 

Lemma 3.3 (Progressions lie inside proper progressions). \12\ Theorem 3.40] There is an 
absolute constant C such that the following holds. Let P be a GAP of rank r in R. Then 
there is a proper GAP Q of rank at most r containng P and 

\Q\<r^''\P\. 

Proof, (of Lemma l3.2p We shall mainly follow |2H Section 8] and [13, Section 6]. 

Suppose that ^{U) does not have full rank, then it is contained in a hyperplane of R*". In 
other words, there exist integers ai, . . . , whose common divisor is one and aimi + • • • + 
UrTUr = for all (mi, . . . , m^) S ^{U). 

Without loss of generality, we assume that Oj- 7^ 0. We select w so that gr = OrW, and 
consider P' be the GAP generated by 5^ := gi — aiW for 1 < i < r — 1. The new GAP P' 
will continue to contain U , because we have 
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90 + mig[ H h mr-ig'r_i = go + migi H h m^^r - w{aimi H h argr) 

= migi H h rrirgr 

for all (mi, . . . ,mr) € <&(C/). 

Also, note that the volume of P' is 2'"~'^{N{ - Ni + 1) ■ ■ ■ (7V;„i - Nr-i + 1), which is less 
than the volume of P. 

We next use Lemma 13.31 to guarantee that P' is proper without increasing the rank. 

Iterate the process if needed. Because we obtain a new proper GAP whose rank strictly 
decreases each step, the process must terminate after at most r steps. 

□ 

3.4. Rational commensurability. This section shows that if v is a normal vector of 
a hyperplane generated by vectors of bounded integral components, and if most of the 
components of v belong to a GAP, then all of the components belong to a GAP of rank 1 
and of relatively small length. 

Lemma 3.5 (Rational commensurability). Let v = {vi, . . . ,Vm) be a vector such that all 
but m'' components Vi belong to a proper symmetric GAP of rank Oc,t{^) and size m'^'~^'^^^\ 
and that v is a normal vector of a hyperplane spanned by vectors of integral components 
bounded by m^'^'^^^\ Then {vi, . . . ,Vm} C {{p/q)viQ, \p\, \q\ < m'-''-''^^"^''^} for some if). 

This is basically [13^ Lemma 9.1]. Allow us to reprove it where for the completeness of the 
note. 

Proof, (of Lemma [33]) Without loss of generality, we assume that {vm-m^, ■ ■ ■ ,Vm) sue the 
exceptional elements that may not belong to the GAP. 

For each Vi, where i < m — m'^, there exist numbers Vij bounded by m^'^'^^^^ such that 



Vi = Vagi + . ..Virgr, 
where gi, . . . ,gr are the generators of the GAP. 

Consider the m by r + m*^ matrix whose i-th column is the vector {vn, . . . , Vir, 0, . . . , 0) 
if i < m — m^, and (0, . . . , 0, 1, 0, . . . , 0) if m — < i. Note that has rank r + m'^. 

We thus have 
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where u = {gi, . . . ,gr,Vm-m^,- ■ ■ ,Vm)- 

Next, let wi, . . . ,Wm-i be the vectors of integral entries bounded by m'^'^-^^^^ which are 
orthogonal to v. We form a m by m matrix whose i-th. row is Wi for i < n — 2, and 
the m-th row is e^Q, the unit vector among the standard basis {ei, . . . ,6^} that is linearly 
independent to tfi, . . . , Wm-i- 

By definition, we have MyjV^ = (0, . . . , 0, Vjp, 0, . . . , 0)^, and hence 

(M^M„)tx^ = (O,...,0,t;,o,0,...,0f . 
The indentity above implies that 

(M^M„)(— • n)^ = (0, . . . , 0, 1, 0, . . . , of. (2) 
Next we choose a submatrix M of size r + rrf by r + rrf of M^M^ thas has full rank. Then 

M{—-uf = x (3) 
for some x which a subvector of (0, . . . , 0, 1, 0, . . . , 0) from ([2]). 

Observe that the entries of M are integers bounded by mP'^'''^^^ Solving for gi/vi^^ and 
Vj/vig from ([3]), we conclude that each component can be written in the form p/q, where 

□ 



4. Proof of Theorem 11.31 

In this section we prove our main theorem. Let ri, . . . , r„ be the row vectors of Qn, we will 
show 

Theorem 4.1. Let 1 < m < n — 1. Assume that Qn is a random (0, 1) matrix whose rows 
are independent vectors of exactly n/2 zero components. Then for any C > 

P(ri, . . . ,TfYi generate a subspace H of dimension m, and r^-i-i 
where the implied constant depends on C . 

It is clear that Theorem 14.11 implies Theorem ll.3i We next claim that its suffices to work 
with the case of m being large, m = n — O(logn). 
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Claim 4.2. Let H C R" be a subspace of dimension m = n — uj{log n), and r = (ri, . . . , r„) 
be a random (0, 1) vector of exactly n/2 zero components. Then we have 

P(r G H) =n~'^(^). 

Proof, (of Claim [32]) Because r G H, there exist m components, say rn, . . . , rim, such that 
for any d ^ {ii, . . . , im}, there exist numbers Odi, ■ ■ ■ , adm depending on H such that 

m 

Thus we can bound the probability P(r G H) by 



P(r G H) < 

max(0,m— n/2)<t<min(m,?i/2) 

As m = n — a;(logn), it is clear that 2*" = 2^ /n^^^\ and so 

P(r G H) =n-^(i). 

□ 

Because H, the subspace generated by ri, . . . ,rm, has rank m, there is a nonzero vector 
a = (oi, . . . , Om+i, 0, . . . , 0) which is orthogonal to H and aj = for m + 2 < i < n. Thus, 
condition on ri, . . . , r^, the probability that the next row r^+i = (a^i, . . . , x„) belongs to 
H is bounded by p*{A) = P(xiai + • • • + x„an = 0|ri, . . . , rm), where A = {ai, . . . , a„}. 

For Theorem 14.11 there is nothing to prove if p*{A) < n~'^ . Assume otherwise, we will 
apply the following structural result. 

Lemma 4.3 (Inverse Step). Assume that 



p*{A) = P(xiai H h x„a„ = 0|ri, . . . ,rm) > n ^ . 

Then there exists a nonzero vector u = (ui, . . . , Un) which satisfies the following properties. 

• u is orthogonal to the rows ri, . . . ,rm, o,nd p*(U) = p*{A), where U = {ui, . . . ,n„}. 

• Every Ui can he written in the form p/q, where p,q are integers and \p\,\q\ < 
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• Either there are n — v}!'^^'' components Ui that take the same value or all but 
j^i/2+e of Ui (counting multiplicity) belong to a GAP of rank Oc,ei^) and of size 

Assume Lemma [4.31 for the moment, we next proceed to the Counting Step to complete the 
proof of the main result of this section. 

Proof, (of Theorem 14. ip We will consider two cases, depending on the structure of u. 

Case 1. We first consider the probability P" of the event that the first m rows of Qn-i 
are orthogonal to a nonzero vector u for which there are uq := n — n}!'^'^'^ components Ui 
taking the same value. 

By paying a factor (^^) in probability, we may assume that u\ = ■ ■ ■ = Ung ■ Thus 

u = {ui, . . . ,ni,n„(,+i, . . . ,n„). 

Let Qm be the matrix of the first m rows of Qn, and let Q be the m by n — no matrix whose 
first column is the sum of Qm's first no columns, and Q's i-th column is Qm's (no + i)-th 
column for other i. By definition, the row vectors of Q are orthogonal to the nonzero vector 
u' = (ui, n„Q+i, . . . , Un)- Thus Q has rank at most n — no — 1. 

We now bound the probability of the event that Q has rank at most n — no — 1. By paying 
another factor of [^^~^_^) in probability, we may assume that any row of index at least 
n — HQ belongs the subspace H generated by the first n — no — 1 rows of Q. We will rely on 
the following simple claim. 

Claim 4.4. Let e < 1/4 be a fixed constant. Let H be a hyperplane in R"~"'0, and x = 
(xi, . . . 

jXn—no) be a random vector such that 

and (x2, . . . ,Xn-no) are chosen uniformly from all (0, 1) vectors of exactly n/2 — xi unit 
components. Then, as n is sufficiently large, one has 

P(x G H) < 3/4 + e. 

Proof, (of Claim 1331) Let h = (hi, . . . , hn-no) be the normal vector of H. We first assume 
that there exists 2 < i^ < < n — uq such that /ijp ^ hj^^ . Without loss of generality, 
assume furthermore that io = n — no — 1 and jo = n — uq. It then follows that for any 
chosen tuple (/i, . . . , /n-no-2), either (/i, . . . , /„_„o_2, 0, 1) or (/i, . . . , /„_„(,_2, 1, 0) does 
not belong to H. On the other hand, it is follows from the distribution of x that the 
probability Px(a;i + • • • + Xn-no-2 = 'n/2 — 1) is at least 1/2 — 2e. So we have 
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P(x G H) < 3/4 + e. 

Now assume that /12 = • • • = /in-no = h. In this case, x G H if and only if xihi + h{n/2 — 
xi) = 0. On the other hand, by the distribution of xi, it is clear that P(xi = k) < 3/4 for 
any k, so one also has P(x € H) < 3/4 in this case. □ 

By Claim S31 the probability that all rows of Q of index at least n — riQ belong the subspace 
H generated by Q's first n — uq — 1 rows is bounded by 



(3/4 + e)'"«. 

Putting everything together, we obtain the following bound for P" 

pB</'^V V3/4 + er = (3/4 + 6)(^-°«)". 

\noJ \n-no- I J 

Case 2. We consider the probability P'' of the event that the first m rows of Qn are 
orthogonal to a nonzero vector u for which the following properties hold. 

• n-^ < p*{U) = 0,{W). 

• Every Ui can be written in the form p/g, where \p\, \q\ < n'^'^-^^""). 

• Ah but Qf ^.^g belong to a GAP of rank Oc7,,(l) and of size 0((p*(;7))~V™') • 

Let < (5 to be chosen. We divide the interval [n~*^, Oe{n~'')] into sub-intervals 
where e/6 < k < C/S. For each k, let be the collection of u's such that p*{U) G 
and let Pfc be the probability that the first m rows of Qn-i are orthogonal 
to one of u from Gk- 

We now bound the size of G^. To do this, we first count the number of GAPs which 
may contain most of the components of vectors u from Gfc, and then count the number 
of u's whose components are chosen from the given structures. By Lemma 13.21 one can 
assume that all the GAP generators are of the form p/q, where \p\, \q\ < (^n^cA"'')'jOc,tii) _ 
nOcA^n, Because each GAP has rank Oc,,(l) and size 0{{p*)-'^ /n^) = 0(n^(''+^V"'')> the 
number of such GAPs is bounded by 

(„Oc,K))Oc„(l)(^5(fc+l)/^e)Oc,(l) ^ 0(„Oc,.K)). 

After choosing a GAP of size 0(n^(^+^)/n^), the number of ways to choose n — n}-!'^^'^ of 
the Uj's as its elements is 
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For the remaining n}!'^^'^ exceptional elements, there are {rfcA'^'')'Y^^'^^^ = n^c.tii^^^'^^^'') 
ways to choose them from the set {p/q, \p\, \q\ < n'-^'^-^^"'-')}. 

Putting these bounds together, we obtain the following bound for the number of u of 

IGfcl = 0{nO^-^-'''^''\n'^'^+'^/nT-''''"^')- 

Now, for given u G G^, the probability that the first m rows of Qn-i are orthogonal to u 
is {p*{U))"^ < {n~^^)^. Thus we can estimate as 

provided that 5 was chosen to be smaller than e/3. 
Summing over k, we thus obtain 

k<C/5 

□ 

It remains to justify the Inverse Step. 

Proof, (of Lemma l4.3p Let A denote the multiset {oi, . . . , a„}. As p*{A) > n~'~" , we have 

p{A) = nip*iA)/^) = l^(n-^+i/2). 

We first apply Theorem l2.1l to the multiset A = {ai, . . . , a„} with n' = rf to obtain a GAP 
of rank Oc,e{^) and size vPcA'^) that contains all but rf elements of A. Next, because 
a = (ai, . . . , Om+i) is orthogonal to the rows of Qm^ the matrix of rank m generated by the 
first m rows of Q, we infer from Lemma [3.5l that all of the Oj's have the form {p/q) ■ with 
some integers \p\, \q\ < rpcA"^^) and with some fixed i^. 

Set 

u = (ui, . . . ,M„) := — • a. 
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It is clear that the nonzero vector u is orthogonal to ri, . . . , r^, and p*{{ui, . . . , Un}) = 
p*{A). We next consider two cases. 

Case 1. If there are more than n — n}!'^^'^ components Ui which take the same value, then 
there is nothing to prove. 

Case 2. If this is not the case, then by Corollarv 12.41 we have p*{U) = 0{n^''). Next, 
because p*{U) > , we apply Theorem 12.31 to the multiset U = {ui, . . . with n' = 
j^i/2-i-e obtain a GAP of rank 2 < r = Oc^e(l) and size 

|P| = Oc,e{p*V^/n') = OcAiP*iU))-'/n')- 

□ 
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